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Abstract. Road detection is important in computer vision for autonomous 
driving, pedestrian detection and other applications. Visible light (VL) camera 
is often used for daytime road detection, and infrared camera is often used for 
night road detection. Vanishing point (VP) detection is useful for inferring road 
region. Many VP detection methods have been proposed and applied 
successfully in VL road image. However, there is no special VP detection 
method for infrared road image. In this paper, we propose a VP detection 
approach for infrared road detection. The novelty of our approach relies on the 
rational assumption that the regions are very similar along the direction of the 
true VP. This assumption is involved in finding effective VP voters by using a 
non-local similarity manner, and these VP voters estimate the VP together. 
Quantitative and qualitative experiments show the effectiveness and efficiency 
of the proposed method. 

Keywords: Vanishing point detection, Infrared Road detection, Non-local 
similarity. 


1 Introduction 

Road detection is an important research topic in the area of transportation systems, 
such as autonomous driving [1-2], driver assistance systems [3-4] and so on. Visible 
light (VL) camera is often used for daytime road detection [5], and infrared camera is 
often used for night road detection [6]. Vanishing point (VP) detection is useful for 
inferring road region. Many VP detection methods have been proposed and applied 
successfully in VL road image [7-8]. The state of the art vanishing point detection 
method is based on texture analysis, such as Gabor filter[9], Laplacian of Gaussian 
Filters [10] or edge detection [11]. However, there is no special VP detection method 
for infrared road image. In addition, VP detection based on texture analysis is hard for 
infrared images since infrared image usually has weak texture, and the edge 
magnitude is also small since the temperature of road and non-road region varies 
smoothly. 

In fact, we observe that the road boundary or some of objects in a road scene 
usually have high similarity along the direction of VP. For a road region in an image, 
we can find regions similar with the region in all direction. For road boundary 
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regions, we can only find high similarity along the direction of vanishing point. For 
some of non-road region, we can not find high similarity regions or we can find 
similar regions in all direction similar to the road region, for other non-road regions, 
we can also find similarity regions along the direction of VP similar to boundary 
regions. Applying this prior, we design an effective and efficient VP detection method 
for infrared road image. This idea is very similar to the principle of non-local 
similarity, which has been applied successfully in image de-noising [12] and image 
representation [13]. Their difference is the aim of finding several similar regions in 
non-local regions is to investigate their space distribution, that is, the centers of 
similar regions distribute in a line type or a cluttered type, other than to calculate the 
average of similar regions or the representation for an image patch. 

The primary superiority of our method is that it needs no magnitude threshold 
selection for edge detection and scale parameter turning for texture analysis, instead, 
the intensity information of an original image is used directly. 


2 Proposed Method 

Our approach broadly consists of three stages: high contrast point extraction, voter 
point selection and vanish point voting. Below, we describe each stage in detail. 


2.1 High Contrast Point Extraction 


Considering road region is always in the bottom of the road image in vision 
navigation scene, so the first preprocessing step consists the generation of a mask that 
restricts the area of analysis, as shown in Fig. 1(b), or we call region of interest (ROI). 

Beside, computational efficiency is necessary and considered a lot, so we sample 
pixels where the region centered at this pixel has high contrast as processing objects, 
generally, these pixels and its surrounding region are very useful for VP voting. 
Ref. [14] proposed a simple but effective method for high contrast region extraction, it 
uses a simple measure of local contrast which is defined as the local standard 
deviation s of the image intensities divided by local mean intensity U : 
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w, h represent image width and height, f tJ is denoted as intensity of the pixel in the 
image coordination (/, j ) we set W — /? — 1 1 in our experiments. 
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We find that this method is insensitive to image noise. We applied this method for 
our ROI extraction. For each pixel p t in the ROI of original infrared image, we 


calculate C- according to equation (1). Fig. 1(c) show the contrast map of Fig. 1(a). 

Then we use calculate a threshold T to select high contrast points based on follow 
equations. 
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where H p = 1 means p { is a high contrast point, otherwise not, U and s' are the 

mean and the standard deviation of the set{c-} respectively, their calculation is 

similar to equation (2) and (3), £ is a small constant, we set £ = 3 in our 
experiments. Fig. 1(d) show extracted high contrast points. 



Fig. 1 . High contrast points extraction, (a) an infrared road image, (b) mask image depicting 
region of interest,(c) contrast map, and (c) high contrast points (white points). 


2.2 Voter Point Selection 

Now, a set of high contrast points are obtained, we further select points which can be 
used for VP voting from these high contrast points, the new selected points are called 
voter points. 

For road image, the road pavement is always regular along the direction of VP, 
especially for some off-road regions. We often find that there are sidewalks, water 
ditch, vegetation, along the two side of the road, they are companion with the road, 
and they will give good inferring information for VP detection. Due to the perspective 
projection, these regions are distributed along the direction of VP. 

In infrared image, a high contrast point being a voter point should pass following 
test, that is, if we search in a fixed rectangle region, which is above current high 
contrast point, as the white rectangles shown in Fig.2(a), we will find several similar 
regions. The search region and search strategy is importance, if we find similar region 
only in the neighborhood region of a pixel, it will lead to unbelievable result since 
region has local similarity. We select the most similar region in each row of the 
search regions (white rectangle), and we select the top N regions based on their 
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similarity. Generally, correlation coefficient is often used to measure the similarity of 
two regions: 
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Where M and I are two image patch, M and I are their mean respectively. 

In fact, we find the absolute difference (equation (7) also works and it is more 
efficient than correlation coefficient. 
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So we applied absolute difference to measure similarity. If the dif is small than 

threshold (we set 3 in our experiments), we consider two comparison regions are 
similar. After obtaining similar regions, we further judge the position relationship of 
center points of these regions. First, these regions should aggregate in a line type, 
second, the number of these regions should large than half of the selected similar 
regions. If the two conditions are satisfied, a voter point is found. Fig.2(a) show two 
regions (red rectangles) center at their voter points and their similar regions (blue 
rectangles). 



(a) (b) (c) 


Fig. 2. Vanishing point detection, (a) two regions center at their voter (red rectangles) point and 
their similar regions(blue rectangles), and the fitting line using center point of these similar 
regions (yellow and green line), (b) voting accumulation map, and (c) detected vanishing points 
(red points). 


2.3 VP Voting 

For each voter point and the center points of its non-local similar regions, we can fit a 
straight line use minimum distance error criteria. 

| Ax + By + C 

VA 2 + 5 2 

N 
7=1 


e = min- 


N 


( x , y)e 

(*/.?/) 


( 8 ) 








VP Detection Based on Infrared Road Images for Night Vision Navigation 


615 


That is, for any two points, a straight line is fit. Then we calculate the distance 
error from a point (x, y) to the fit straight line equation Ax + By + C = 0 , and 

average distance is obtained. The straight line which takes the minimum average 
distance error e is selected. 

By generating an accumulation image initialized with zero, all the points in the fit 
straight line are accumulated in the accumulation image. The accumulation image of 
Fig.2(a) is shown in Fig.2(b), and then the position with maximum accumulation 
value in the accumulated image is considered as the VP, as shown in Fig.2(c), 

3 Experiments 

All the experimental data in this paper are captured by a infrared camera which is 
mounted in the front floor of our autonomous lane vehicle. The image resolution is 
352 by 288. Some typical detection results are reported in Fig. 1,where the six figures 
depict different scenes include two type pavement, sandstone road and cement road, 
and different non-road objects, such as trees, vegetations, sidewalk involved with 
shadows and so on. Red crossing show their VP detection results. 



Fig. 3. Results of vanishing point detection in different road scene 

We also select two state of the art VP detection methods for comparison. The two 
methods are proposed in Ref. [9] and Ref. [10]. One is based on Gabor filter, and the 
other is based on Laplacian of Gaussian Filters. It should be noted here that the two 
methods for comparison obtain similar results as our method for the images shown in 
Fig.3. However, they are not robust for other images in our database. We show some 
VP detection results which the two methods fail but our method succeeds in Fig.4. 
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Fig. 4. Comparison of the three methods, (a) method proposed in Ref. [9], (b) method proposed 
in Ref. [10], (c) our method. 

Finally, we test the average processing time of the three methods with more than 
500 images of the dataset. All methods runs in a PC whose main configure are: CPU: 
AMD2.0, memory Size: 1G, and VC++6.0 develop environment is used. We coarsely 
compare the average processing time of the three methods in table 1. It is clearly 
shown that our method is more efficient. 

Table 1. Comparison of Average processing time 

Methods_Average time(second)_ 

Ref. [9] 40.73 

Ref [10] 20.21 

Our methods 7.68 


4 Conclusion 

VP detection is very important and useful for road detection, most VP detection 
methods are proposed for visual light (VL) images in last decades and many have 
been demonstrated very effective for road detection. However, little literature 
investigates infrared image based VP detection. In essential, the VP detection 
methods based on VL image usually can not be used to infrared images 
straightforward since the texture of infrared image is very weak. This paper proposed 
a simple but effective approach for infrared based VP detection. Experiments on real 
infrared road image sequences demonstrate its effectiveness and efficiency. In the 
future, we will apply our VP detection method to detect road boundaries in infrared 
road images. 
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